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Abstract 

In  multi-agent  systems,  roles  provide  an  apriori  decomposi¬ 
tion  of  the  task  based  on  the  interactions  of  the  agents.  Roles 
are  instantiated  by  the  agents’  actions  and/or  messages.  Role 
allocation  has  emerged  as  a  key  computational  tool  in  the  co¬ 
ordination  of  intelligent  agents  who  are  flexible  enough  to 
take  on  any  role.  It  is  in  this  context  that  some  rethinking 
about  roles  and  their  representation  is  needed.  Illustrations  in 
the  game  of  Go,  a  game  of  strategy,  highlight  the  key  issues. 


Introduction 

Roles  have  emerged  as  a  powerful  computational  abstrac¬ 
tion  for  the  coordination  of  multi-agent  systems.  Roles  are 
broadly  defined  here  as  encapsulated  behaviors  used  to  solve 
a  task  requiring  no  learning  or  planning  from  first  principles 
and  enabling  the  reusability  of  a  solution  in  multi-agent  sys¬ 
tems.  In  this  context,  a  strategy  can  be  viewed  as  a  compo¬ 
sition  of  roles.  Roles,  as  abstract  entities,  can  be  assumed 
and/or  assigned  and  therefore  lend  themselves  both  to  self¬ 
organization  and  mixed  strategies  where  human-in-the-loop 
interactions  require  a  higher  level  of  granularity  in  the  ar¬ 
ticulation  of  goals.  In  practice,  the  distinction  between  an 
agent  and  its  role  mitigates  the  usefulness  of  this  conceptual 
abstraction. 

It  was  the  game  of  Go'  that  led  John  Nash  to  game  theory. 
Indeed,  the  interaction  between  the  stones  in  Go  has  a  close 
resemblance  to  the  interaction  of  intelligent  agents  due  to  the 
absence  of  constraints  in  the  type  of  move,  including  suicide. 
Go  is  a  two-player  game  played  with  stones  of  different  col¬ 
ors.  Starting  from  an  empty  board,  stones  are  added  in  turn 
on  the  intersection  of  lines  of  a  variable-size  board,  usually 
19  X 19.  Stones  are  captured  if  surrounded  by  stones  of  the 
opposite  color.  Winning  the  game  means  to  acquire  more 
territory  than  the  opponent  (Fig.  1).  Territory  is  defined  as 
free  intersections  surrounded  by  stones  of  your  own  color  or 
the  edges  of  the  board.  A  mapping  can  be  made  between  the 
territorial  relationship  of  the  stones  on  the  board  and  their 
respective  role  in  the  game.  Each  move  in  the  game  can  be 
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*  A  good  introduction  can  be  found  at  http://www.usgo.org. 


Figure  1:  Territory:  Black  wins  with  a  32/30  free- 
intersection  advantage  over  White. 

explained  away  by  its  purpose.  There  are  three  phases  in 
the  game  of  Go  which  are  not  always  temporally  or  visually 
distinct.  The  opening  phase  in  the  corners,  called  josekis, 
has  been  extensively  studied  and  “dictionaries”  of  opening 
templates  are  available.  The  endgame,  where  the  board  can 
be  decomposed  into  independent  regions,  has  been  practi¬ 
cally  solved  with  combinatorial  game  theory  (Berlekamp  & 
Wolfe  1994).  The  middle  game,  however,  is  still  intractable 
and  hasn’t  been  reduced  to  any  single  approach.  Go  is  a 
challenging  platform  for  AI  techniques  (Bouzy  &  Cazenave 
2001)  and  has  replaced  chess  as  the  “drosophilia  of  AI.”  This 
paper  claims  that  Go  is  also  an  excellent  platform  for  multi¬ 
agent  systems. 

This  paper  is  organized  as  follows.  We  first  introduce  the 
practical  contexts  for  multi-agent  systems  (MAS)  in  our  re¬ 
search  in  which  to  frame  common  “myth  conceptions”  about 
roles,  namely  multiple  roles,  open  environments,  and  mixed 
strategies.  Three  myths  are  then  defined  and  possible  ap¬ 
proaches  described. 

Roles  in  Multi- Agent  Systems 

Some  issues  about  roles  arise  in  the  following  contexts  in 
the  development  of  multi-agent  systems. 

Multiple  Roles 

Role  allocation  can  be  viewed  as  a  constraint  satisfac¬ 
tion  problem  (CSP)  similar  to  resource  allocation  problems 
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where  agents  are  variables  (xi, x„)  and  roles  are  values 
that  those  variables  can  take.  When  a  utility  or  preference  is 
attached  to  an  assignment,  role  allocation  also  entails  a  con¬ 
straint  optimization  problem.  There  are  typically  N  roles 
and  N  agents  and  the  goal  is  to  maximize  the  sum  of  utilities 
or  Pareto  efficiency  in  assigning  agent  Xi  to  role  j  subject  to 
the  constraint  that  Xi^N  i=-  In  dynamic  environ¬ 

ments  with  partial  observability,  this  constraint  must  be  re¬ 
laxed  and  the  optimization  goal  becomes  elusive.  The  multi¬ 
agent  system  problem  can  be  formally  described  as  follows: 

•  Xi  =  j  ^assignment  of  an  agent  i  to  role  j 

•  Uij  <— utility  of  role  j  to  agent  i,  where  Uij  =  1 

•  Wj  <— priority  of  role  j  in  the  global  task,  where  ^  wj  = 
1 

•  Maximize  j  UijWj  or  Pareto  efficiency  of  a  solution 

When  the  global  task  consists  of  multiple  coordination  tasks 
and  multiple  teams  coexist,  an  agent  can  take  on  multiple 
non-conflicting  roles.  The  goal  is  then  to  maximize 

— m 

where  t  is  the  number  of  teams.  Over-constrained  situ¬ 
ations  where  a  team  cannot  be  formed  because  of  an  in¬ 
sufficient  number  of  agents  are  not  relevant  here.  Rather, 
an  agent  has  to  assume  multiple  roles  in  those  situations. 
The  capability  to  handle  multiple  roles  is  an  important  as¬ 
pect  of  the  coordination  of  intelligent  agents  to  achieve  the 
promised  payoff  of  multi-agent  systems.  In  order  to  extend 
role  allocation  algorithms  to  multiple  roles,  the  myth  that 
roles  are  “crisp”,  that  is  distinct  and  non-overlapping,  must 
first  be  addressed. 

Open  Environments 

Open  environments  are  characterized  by  dynamic  team  for¬ 
mation,  multiple  and  changing  goals,  non-deterministic  state 
transitions,  variable  resources,  and  unreliable  communica¬ 
tion  (Abramson  &  Mittu  2004;  Dastani,  Dignum,  &  Dignum 
2003).  In  this  context,  roles  become  fluid  since  the  possi¬ 
bility  of  finding  a  better  match  for  the  role  required  exists. 
The  cost  in  switching  roles,  such  as  increased  communi¬ 
cation,  must  be  balanced  against  possible  benefits.  In  the 
game  of  Go,  as  in  open  environments,  stones  can  be  added 
at  any  time  if  free  intersections  remain  and  there  is  no  limit 
to  the  number  of  stones  that  can  be  played.  In  order  to  ex¬ 
tend  multi-agent  systems  to  open  environments,  the  myth 
that  roles  are  “static”  must  first  be  addressed. 

Mixed  Strategies 

Roles  provide  the  high-level  granularity  for  a  human-in-the- 
loop  type  of  strategy  to  direct  the  task  while  coordination 
can  occur  at  the  lower  level  of  primitive  action  selection. 
In  this  context,  it  is  not  clear  that  only  strategic  level  roles 


Figure  2:  Myth  1  -  In  this  situation,  ’A’  is  the  vital  point  for 
White  for  both  attacking  and  defending.  (Tisheng  &  Wen 
1983) 

are  those  candidates  for  human  intervention.  The  dichotomy 
between  tactics  and  strategy  and  where  priorities  lie  is  not 
always  clear.  In  the  game  of  Go,  strategic  moves,  called 
fusekis,  occur  in  the  opening  and  affect  the  general  outcome 
of  the  game.  However,  an  evaluation  function  of  the  moves 
in  Go  has  been  so  far  elusive  so  that  there  is  no  guarantees  of 
winning  the  game  after  the  initial  strategic  phase.  This  pro¬ 
vides  a  dilemma  on  what  should  be  brought  up  to  the  human 
attention.  In  order  to  get  some  insights  into  this  problem, 
the  myth  that  roles  are  “flat”,  that  is  one-dimensional,  either 
tactical  or  strategic,  must  first  be  addressed. 

Myth  1:  Roles  are  “crisp” 

Not  only  do  we  multitask  out  of  necessity,  but  one  highlight 
of  intelligence  is  flexibility  and  adaptability  in  our  interac¬ 
tions  towards  our  peers  and  the  environment.  Premature  role 
allocation  leads  to  suboptimal  situations  and  missed  oppor¬ 
tunities  especially  in  an  open  environment.  Maximum  co¬ 
ordination  efficiency  is  obtained  when  one  action  can  ful¬ 
fill  multiple  roles  (Fig.  2).  This  suggests  that  coordination 
problems  should  be  addressed  at  a  lower  level  of  granular¬ 
ity  by  decomposing  roles  into  primitive  actions  (Abramson 
&  Mittu  2004).  Such  an  approach  view  roles  at  the  spec¬ 
trum  of  a  continuum  of  primitive  actions  leading  from  large- 
scale  coordination  to  local  teamwork.  Another  approach,  the 
token  approach  (Scerri  et  al.  2004),  keeps  non-conflicting 
roles  intact  and  delays  commitment  to  a  specific  role  but 
does  not  directly  address  the  problem  of  multiple  role  in¬ 
stantiations  . 

Myth  2:  Roles  are  “static” 

Sure,  some  roles  are  well-known  apriori  such  as  who  drives 
the  car  and  who  is  a  passenger  in  the  car.  But  new  roles 
are  constructed  dynamically  and  created  or  destroyed  all  the 
time  to  respond  to  the  need  for  coordination  (Brooks  1995). 
That  is  the  motivation  given  for  the  rise  and  fall  of  “orga¬ 
nizations”.  This  suggests  that  roles  have  to  be  synthetized 
on  the  fly  to  respond  to  dynamic  situations  affecting  coor¬ 
dination  (Fig.  3).  In  this  context,  roles  are  similar  to  goal- 
driven  behaviors  that  can  be  incrementally  learned  or  mod¬ 
ified  to  perform  a  task.  In  addition,  it  was  shown  that  the 


Figure  3:  Myth  2  -  Dead  stones  can  suddenly  acquire  an 
important  role.  White  can  leverage  from  its  (marked)  dead 
stones  to  kill  black. (Tisheng  &  Wen  1983) 

fluidity  of  roles  enables  better  coordination  effectiveness.  If 
all  agents  are  running  the  same  optimized  algorithm,  e.g. 
distributed  constraint  satisfaction,  they  should  arrive  at  the 
same  solution  with  a  minimum  of  interference  without  the 
need  for  a  consensus  albeit  with  increased  communication 
to  share  state  information  (Abramson,  Chao,  &  Mittu  2005). 
How  often  to  share  state  information  when  communication 
is  unreliable  while  not  contributing  to  congestion?  Insect 
societies,  such  as  the  honeybees,  demonstrate  a  plasticity  in 
the  division  of  labor  of  their  members  according  to  age  and 
environmental  conditions.  Response  thresholds  (Bonabeau, 
Dorigo,  &  Theraulaz  1999)  are  a  way  of  reacting  efficiently 
to  environment  conditions  in  order  to  tune  or  switch  roles  in 
situations  where  the  ownership  of  a  role  is  not  exclusive  to 
an  agent.  How  to  use  stigmergy  to  save  on  communication 
costs  associated  with  role  allocation  in  a  dynamic  environ¬ 
ment? 


Figure  4;  Myth  3  -  Whole  board  considerations  makes  a 
“small”  tactical  move  at  B  more  “urgent”  than  the  “big” 
move  at  A. (Tisheng  &  Wen  1983) 


Myth  3:  Roles  are  “flat” 

Roles  structure  interactions  in  relation  to  a  goal.  Roles  can 
be  represented  as  adjacency  relations  within  a  conceptual 
graph  (Sowa  1984)  relating  agents  in  a  task  at  the  intentional 
level  but  their  extensions  into  actions  and/or  messages  might 
suggests  different  interpretations.  CSP  algorithms  evalu¬ 
ate  roles  in  relation  to  other  roles  but  fail  to  take  multiple 
goals  into  account  leading  to  planning  considerations.  Get¬ 
ting  the  right  local  context  in  which  to  evaluate  roles  en¬ 
abling  a  satisficing  solution  is  necessary  but  difficult  to  do 
in  a  multi-agent  system  (Fig.  4).  How  much  information 
should  be  relayed  to  the  agents  in  order  to  obtain  the  cor¬ 
rect  context?  How  fine-grained  should  the  interactions  be? 
Similarly,  in  the  game  of  Go,  “whole-board”  considerations 
(Yang  &  Straus  1996)  arise  in  the  interplay  between  strategic 
fusekis  and  tactical  josekis  in  the  opening  (Fig.  5). 

Tuple-space  modeling  (Gelernter  1985)  is  an  attempt  to 
establish  an  apriori  context  for  coordination  tasks  involving 
communication  while  coordination  graphs  (Guestrin,  Roller, 
&  Parr  2002)  provides  an  apriori  context  for  tasks  not  neces¬ 
sarily  requiring  communication.  Peer-to-peer  discovery  is  a 
dynamic  way  of  establishing  the  proper  interaction  context 
between  agents. 


B  is  the  correct  move  A  is  the  correct  move 

Figure  5:  Interplay  between  fusekis  (moves  1,2,3,4,  and  5) 
and  josekis  (upper  left  corner)(Yang  &  Straus  1996) 


Conclusion 


Although  roles  are  a  powerful  computational  tool,  a  flexible 
granularity  is  needed  to  address  the  multiple-role  problem  in 
intelligent  agents.  Some  of  the  usefulness  of  roles  as  apriori 
decomposition  of  tasks  might  be  a  limitation  with  new  tasks 
requiring  on-the-fly  synthetization  of  roles.  While  behaviors 
are  goal-oriented,  roles  are  defined  in  relation  to  other  roles 
for  the  only  purpose  of  coordination  and  might  only  indi¬ 
rectly  relate  to  the  task.  Coordination  in  multi-agent  sys¬ 
tems  needs  to  interleave  the  creation  of  new  roles  with  role 
allocation  at  the  proper  abstraction  level. 

The  author  wants  to  acknowledge  useful  discussions  with 
Joe  Collins  and  Mike  Stein. 
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